System to navigate within images spatially referenced to a computed space

ABSTRACT

A system for navigating images spatially referenced to a plurality of location coordinates from at least one coordinate location within a computed space provides travel with a non-linear itinerary. Specifically, serial navigation of a plurality of geographic images spatially referenced to location coordinates of a geo-planar space from a selected coordinate location within each prior geographic image.

This application is the United States National Stage of InternationalPatent Cooperation Treaty Patent Application No. PCT US/2003/014378,filed May 5, 2003, and claims the benefit of U.S. Provisional PatentApplication No. 60/377,642, filed May 3, 2002, each hereby incorporatedby reference herein.

I. TECHNICAL FIELD

A system for navigating visual information such as images spatiallyreferenced to location coordinates within a computed navigation spacefrom an origin coordinate location within the computed navigation spaceto provide computed travel having a non-linear itinerary. Specifically,non-linear serial navigation of a plurality of geographic imagesspatially referenced to location coordinates within a geographiccomputed navigation space from a coordinate location selected withineach prior geographic image.

II. BACKGROUND

A variety of computerized devices have been developed to provideelectronic information which may be useful with respect to globalpositioning data, tracking and identifying location of mobile objects,mapping of travel routes, or identification of local resources utilizingdatabase(s) accessible from a single memory element or accessible from acombination of networked memory elements such as the Internet.

The global positioning system (GPS) uses a plurality of satellites toprovide accurate measurements of three-dimensional position. A varietyof conventional GPS devices have been developed to work with informationgenerated by the GPS. With respect to certain conventional devices, anindicator corresponding to the location of an object ascertained by GPScan be superimposed upon a computer generated map or display to provideadditional information to the user as disclosed by U.S. Pat. No.5,471,392. Other types of conventional GPS devices allow the user tolink certain information such as photographic images or geographicinformation to location coordinates as disclosed by U.S. Pat. Nos.5,471,392; 6,282,362; or 5,506,644.

A variety of mobile object navigation devices have also been developedusing the GPS to provide means to track and identify the location ofmobile objects such as vehicles or communication devices such ascellular telephones. Many of these conventional devices match thelocation of a mobile object to locations of fixed roadways and objectlocation may be indicated on road map data stored in a memory asdescribed for example by U.S. Pat. Nos. 5,270,937; 5,270,937; 5,115,399;5,189,430; 5,274,387; or 5,270,937; WIPO publications such as WO01/94882; and other published patent specifications such as EP 1 118837; or EP 0775891.

Certain mobile object navigation devices further provide routedetermination, route calculation, route planning, or route constructionfeatures such as those disclosed by U.S. Pat. Nos. 4,926,336; 5,168,452;5,170,353; 5,041,983; 4,937,753; 4,984,168; 5,031,104; 4,962,458;4,954,958; 5,172,321; 5,041,983; or 6,298,303. These route determinationfeatures may also provide optimized route determination that furtheraccounts for weather or road condition in determining route as disclosedby U.S. Pat. No. 4,926,336. Additional features have been added tocertain route determination devices which provide the user withinformation concerning adherence to determined route as disclosed byU.S. Pat. No. 5,523,765; adherence to time schedule in implementing thedetermined route as disclosed by U.S. Pat. No. 5,541,845; or therelationship of the mobile object to landmark data as disclosed by U.S.Pat. No. 5,067,081 or to a plurality of selected location coordinates asdisclosed by EP 0 775 891.

As conventional mobile object navigation technology advanced additionalfeatures have been incorporated to display additional information keyedto coordinate locations in the displayed map as disclosed by EP 0 845124. The additional information may also be displayed in relation to thelocation of the moving object providing blown up portions of thedisplayed map as disclosed by EP 1 024 347; photographic information asdisclosed by U.S. Pat. No. 6,199,014; road information as disclosed byU.S. Pat. No. 5,293,163; hidden features as disclosed by EP 0 802 516;perspective maps as disclosed by EP 0 841 537; rally maps as disclosedby U.S. Pat. No. 6,148,090; or other information concerning places alongthe route as disclosed by U.S. Pat. No. 6,282,489. As to some mobilenavigation technology a preview travelogue customized to the determinedroute can be displayed as disclosed by U.S. Pat. No. 5,559,707; orUnited States application 2002/0038180.

Similarly, with respect to identifying local resources within computergenerated maps, an area is superimposed with or overlaid withinformation corresponding to the location on the map providing detailsof hotels, restaurants, shops, or the like, as disclosed by WIPOpublication WO 97/07467; or U.S. Pat. No. 6,263,343.

Web-based map navigation may further involve the user activating iconson a map image to request information concerning a location or point ofinterest. Internet based map navigation involves transmitting a requestto a server computer via a click event of an icon on a visual displayunit showing a map image. The user's intent can be to learn more about aparticular point of interest. This request causes the server computer totransmit information in the form of text or numeric data, real timevideo images, audio files, PDF documents or in some cases stillphotographs. These multimedia documents are then displayed in the thencurrent window or are displayed in a separate window on screen. Afterreview of this information, the user would return attention to the mapimage on-screen to seek further information at that location or toexplore another location. The geo-referenced map image can be used asthe means of navigating the map space and as the method of organizinggeographically related information.

For example, interactive map sites on the World Wide Web may allow theuser to view maps from many locations around the world. The user may beallowed to manipulate the geographic extent of the map (for example zoomin, zoom out) or change the content of the map (for example determinewhat geographic information should be displayed such as roads, politicalboundaries, land cover, or the like) or navigate to adjacent frameslocated in closest proximity as described by WIPO publication WO01/44914.

In certain internet sites a still image may have associated interactiveprogram content for displaying further selections such as images,ordering information, or purchasing products as disclosed by WIPOpublication WO 98/00976. In some instances a plurality of sub-regionswhich contain a plurality of pixels allow selection of a location withinthe image corresponding to one of the plurality of sub-regions by theuser which creates a link to a corresponding embedded image as disclosedby U.S. Pat. No. 6,356,283.

While there are a variety of navigation devices available for use withmobile objects such as vehicles or cellular telephones and a variety ofresource identification systems available (whether for stand alonecomputers or for networked computer systems), and while there is a vastcommercial market for such devices, significant problems with navigationand resource identification technology remain unresolved.

A significant problem with conventional navigation devices may be thatthe location coordinates used to references features within a displayedimage (whether displayed in three dimensions, two dimensions, or onedimension) such as a planar map do not operate in the additionallydisplayed information or image(s).

One aspect of this problem may be that any further information, image(s)or other view(s) must be obtained by redirecting the user back to thedisplayed image having embedded location coordinates to select otherlocation coordinates or to generate additional image(s).

A second aspect of this problem may be that selection of other locationcoordinates has to be made without the aid of the additionally displayedinformation or images, or without a spatial reference system within theadditionally displayed information or images. As such, if locationcoordinates are, for example, selected within a planar map view (lookingdown on the map image from an overhead vantage point) the user does nothave the advantage of utilizing any other views to make navigationdecisions.

Another aspect of this problem may be that the additional images orinformation displayed are not referenced from the same origin coordinatelocation. User selection of location coordinates within an image mayyield a plurality of additional images each of which may represent viewsor other information recorded from a plurality of different origincoordinate locations. As such, the user may not be able to understandthe relationship of the views to one another.

Similarly, an aspect of this problem may be that the additional imagesor information displayed are not spatially referenced from the selectedorigin coordinate location. This aspect of the problem also relates toadditional images or information spatially referenced to the respectiveorigin coordinate location using different scales. When additionalimages are not spatially referenced from the selected origin coordinatelocation direction and magnitude of vectors may not be capable ofassessment or may be inaccurately assessed by the user. As such, imagesor information not spatially referenced from the selected coordinatelocation or referenced from a different coordinate location thenselected can have little or no value as a navigational guide to theuser.

Another aspect of this problem may be that a plurality of differentlocations may be referenced within or by the additional displayedimage(s) or information generated upon selection of a single coordinatelocation (for example, locations referenced within a single image maycorrespond to the horizon or objects in the foreground). However, theremay not be a positionable indicator in the additional images to identifythe location coordinates of the various locations referenced within theimage or information.

Moreover, if positionable indicators are provided within generatedimages or information the coordinate location indicator within theinitial image may remain spatially fixed even when the positionableindicator within the additional displayed images or other information isaligned with features having different coordinate location(s).

Another aspect of this problem may be that selection of locationcoordinates does not allow directional bias of the additional imagesdisplayed. Typically, selection of location coordinates retrieves allthe images linked to that coordinate location. No means are typicallyprovided to select only those images having a particular vector of aselected direction or magnitude from the origin.

Still another aspect of this problem may be that a three dimensionalspace may be displayed as a planar representation having an X-axis and aY-axis and additional image(s) retrieved through selection of locationcoordinates are displayed as a planar representation having an X-axisand a Z-axis. As such, the Y-axis within the additionally retrievedimages must be generated to identify the coordinate location within theadditional image on the planar representation of three dimensionalspace. Conversely, the Z-axis within the planar computed space must begenerated to identify the location on the computed planar space to thethree dimensions imputed to the additional image.

Yet a further aspect of this problem may be that the user cannotnavigate from a coordinate location in a first retrieved image to acoordinate location within a second retrieved image. Navigation requiresthat visual information referencing destination coordinate locationswithin generated image(s) be spatially referenced from the selectedstarting location coordinates allowing the user to predeterminemagnitude and direction of travel. Similarly, upon arrival at adestination coordinate location additionally retrieved images must bespatially referenced to the destination coordinates to provide visualinformation which conveys additional destination coordinate locations tothe user to select from.

Typically, selection of location coordinates in an initial image mayprovide serial presentation (whether timed serial presentation or usertimed serial presentation) in a predetermined order. As such, the usermay be provided with a slide show of images or information related tothe selected location coordinates which may be drilled down through inlinear fashion.

As discussed above, displayed images or visual information generated inresponse to selection of location coordinates may not be spatiallyreferenced from that selected coordinate location. As such, the user maynot be able to assess what coordinate location travel starts from.Similarly, when portions of the displayed images or visual informationare selectable to retrieve further images or information the user cannotor does not navigate from image to image because the images do notprovide destination coordinate locations for the selectable portions ofthe images or visual information or does not provide an indicator withina separately spatially referenced image to indicate the coordinatelocation of the portion of the image or information selected. As such,the user cannot determine destination coordinate location in advance ofgenerating images or visual information related to that portion of theimage or visual information. Again, images or visual informationgenerated at arriving to the destination coordinate location may not bespatially referenced to the destination location coordinates.

The present invention addresses each of these problems with respect tonavigating computer generated space and offers a solution toconventional travel and tourism websites such as Expedia, Orbitz andothers which offer the means of making travel and tourism purchases offlights, hotel accommodations, automobile rental, restaurantreservations, or the like, which only provide linear drill down withinthe visual information or images for travel investigation. The inventioncan also be applied to the fields such as real estate, education andmedicine, where linking images to a computed navigation space wouldprovide advantages for image information display and retrieval.

III. DISCLOSURE OF THE INVENTION

Accordingly, a broad object of the invention can be to provide a firstimage of a computed navigation space (whether three dimensional, twodimensional, or one dimensional) having selectable location coordinateswhich allow access to at least one database to generate information (aportion of digitally recordable characteristics of a space obtained froma geographic location for example audio characteristics, spectralcharacteristics, energy characteristic, visual characteristics,geographic characteristics, or the like) spatially referenced to thecomputed navigation space from the selected location coordinates(selected coordinate location in the computed navigation space providesthe origin for vectors having direction and magnitude in the accessedinformation) for display as a second image.

The computed navigation space can comprise any manner of spaceconstructed by computer regardless of the number of dimensions,geometric properties, manner of symmetry, whether finite or infinite,having any location within identifiable by the indexing of two or morelocation coordinates (which may refer to column or row information).These coordinates can relate to Earth surface coordinate systems orthose of other planets, or portions thereof. The computed navigationspace can be any manner of computed space including without limitation acomputed tomography (three dimensional image of body structure), acomputed geography (geographical features of an area), a computeduniverse, a computed city, a computed landscape, a computed surface, acomputed structure, or the like. The computed navigation space havingselectable location coordinates is displayed as an image orrepresentation in a first visual field (computer generated field, frame,window, or the like).

A user can make navigational decisions based upon the generatedinformation which is spatially referenced to the location coordinateswithin the computed navigation space from the user's selected coordinatelocation (the selected coordinate location in the first visual fieldprovides the origin in the second visual field from which vectors toselectable location coordinates within the accessed information derivedirection and magnitude) and displayed in a second visual field (secondcomputer generated field, frame, window, or the like).

Another broad object of the invention can be to provide navigationindicators positionably controllable within the first visual field andthe second visual field. One aspect of this broad object of theinvention can be to positionably couple a first navigational indicatorin the first visual field to a second navigational indicator in thesecond visual field. As such, the first navigation indicator trackslocation coordinates in the first visual field as the user positions thesecond navigation indicator within images displayed in the second visualfield. As such, the user can determine location of each coordinatelocation in the image(s) displayed in the second visual field.Alternately, a separate location indicator in the first visual field canbe positionably coupled to the second navigation indicator in the secondvisual field.

Another broad object of the invention can be to provide navigationwithin the computed navigation space through the images displayed in thesecond visual field to obviate the necessity of having to return theuser to the image displayed in the first visual field to selectalternate coordinate locations. As discussed above, one aspect of thisobject is to generate visual information in the second visual fieldspatially referenced to selectable location coordinates within computednavigation space from the selected coordinate locations within thecomputed navigation space. A second aspect of this object of theinvention is to allow the user to select locations in the visualinformation displayed in the second visual field to generate additionalimages spatially referenced to the location coordinates in the computednavigation space corresponding to the selected location in the visualinformation.

Another broad object of the invention can be to directional bias thegeneration of visual information displayed in the second visual field.One aspect of this broad object of the invention can be to generate adirectional vector from the selected coordinate location in the firstvisual field to directionally gate generation of visual informationdisplayed in the second visual field. A second aspect of this broadobject of the invention can be to increment direction of the displayedimage in the second visual field to expose within the second visualfield additional visual information. Another aspect of this broad objectof the invention can be to directionally bias or gate the generation ofvisual information displayed after navigating to a location within adisplayed image.

Another broad object of the invention can be to provide a computedgeographic space represented within the first visual field as ageo-planar map having selectable location coordinates which accessgeographic image(s) spatially referenced to selectable locationcoordinates in the computed geographic space from the user's selectedcoordinate location on the geo-planar map which are displayed in thesecond visual field. A user can position the navigation indicator at adesired destination location in the geographic image displayed andascertain the coordinate locations in the geo-planar view and travel tothat desired destination location

Naturally, further objects of the invention are disclosed in theFigures, Description of the Invention, and Claims.

IV. BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic representation of a computer and internet systemembodiment of the invention.

FIG. 2 illustrates an embodiment of a data structure for a locationcoordinates match element.

FIG. 3 illustrates an embodiment of a data structure for a locationcoordinates match element.

FIG. 4 illustrates an embodiment of a data structure for a locationcoordinates match element.

FIG. 5 illustrates an embodiment of a data structure for a locationcoordinates match element.

FIG. 6 illustrates an embodiment of a data structure for a locationcoordinates match element.

FIG. 7 provides a flow diagram for use of an embodiment of theinvention.

FIG. 8 provides a flow diagram for use of an embodiment of theinvention.

FIG. 9 provides a flow diagram for use of an embodiment of theinvention.

FIG. 10 shows an embodiment of the invention having a database that canbe implemented using related tables in a relational database system(RDBMS).

FIG. 11 shows an embodiment of the invention having a table whichestablishes the location of information hyperlinks on geographic movieimages.

FIG. 12 shows an embodiment of the invention having a table whichestablishes the location of information hyperlinks on geographic movieimages.

FIG. 13 shows an embodiment of the invention having a table which storesphotographic data necessary to support the geographic movie images as aclient application.

FIG. 14 shows an embodiment of the invention having a table which storesphotographic data necessary to support the geographic movie images as aclient application.

FIG. 15 shows an embodiment of the invention having a table whichestablishes the location of information hyperlinks on the geographicimages spatially referenced to the computed navigation space.

FIG. 16 shows an embodiment of the invention having a table whichestablishes the location of information hyperlinks on the geographicimages spatially referenced to the computed navigation space.

FIG. 17 shows an embodiment of the invention having a table whichestablishes the location coordinates and content of hyper-navigationlinks on the geographic images.

FIG. 18 shows an embodiment of the invention having a table whichestablishes the location coordinates and content of hyper-navigationlinks on the geographic images.

FIG. 19 shows an embodiment of the invention having a table whichrecords the geographic coordinates of each photographic locationallowing coordinate locations within geographic images to be displayedon a geo-planar representation of the computed navigation space.

FIG. 20 shows an embodiment of the invention having a table whichrecords the origin geographic location coordinates referenced to thegeographic computed navigation space for each geographic image allowinggeographic photographic image location coordinates to be displayed onthe geo-planar representation of the computed navigation space.

FIG. 21 shows an embodiment of the invention having a table whichassociates multiple geographic photographic images with a single origincoordinate location referenced to selectable location coordinates withinthe computed navigation space.

FIG. 22 shows an embodiment of the invention having a table whichassociates multiple geographic photographic images with a single origincoordinate location referenced to selectable location coordinates withinthe computed navigation space.

FIG. 23 shows an embodiment of the invention which provides a geo-planarrepresentation (2) of the computed navigation space (1) within a firstvisual field (3).

FIG. 24 shows an embodiment of the invention in which the geo-planarrepresentation of the computed navigational space has a positionablycontrollable navigation indicator to select location coordinates.

FIG. 25 shows an embodiment of the invention in which the result ofclicking on the selectable location coordinates in the geo-planarrepresentation retrieves visual information (geographic photographicimage) spatially referenced to location coordinates of the computednavigation space (1) from the selected location coordinates and furtherproviding a persistent leader line to the selected location coordinateswithin the geo-planar representation.

FIG. 26 shows an embodiment of the invention having a positionablycontrollable navigation indicator within the geographic visualinformation to select destination location coordinates and furtherincluding an indicator within the corresponding geo-planarrepresentation that indicates destination location coordinates areenabled.

FIG. 27 shows an embodiment of the invention in which the result ofclicking on the location coordinates within the geographic visualinformation causes the location indicator in the geo-planarrepresentation to move to the destination location coordinates selectedand destination geographic visual information is displayed.

FIG. 28 shows an embodiment of the invention in which the destinationgeographic visual information displayed provides more than onehypernavigation icon visible for selection by the user.

FIG. 29 shows an embodiment of the invention in which destinationlocation coordinates within the geographic visual information areindicated that relate to features in the geographic visual informationof a town.

FIG. 30 shows an embodiment of the invention in which clicking thepositionably controllable navigation indicator on destination locationcoordinates within the geographic visual information of the townretrieves destination geographic visual information which provides aview in the direction of the selected destination location coordinates.

FIG. 31 shows an embodiment of the invention which allows multiplefields for geographic information to be displayed at the same time.

FIG. 32 shows an embodiment of the invention allows multiple fields forgeographic information to be displayed from different azimuth directionsaround the same geographic origin location.

FIG. 33 shows an embodiment of the invention which allows incrementalrotation in azimuth (view direction) about the geographic origin andfurther includes a directional indicator in the geo-planarrepresentation which correspondingly indicates direction of view fromthe geographic origin of the geographic visual information.

FIG. 34 shows an embodiment of the invention which allows a plurality ofgeographic visual information to be displayed from the same geographicorigin but in different seasons of the year.

FIG. 35 shows an embodiment of the invention which provides an automaticoperation feature to navigate the user geographically along a route.

FIG. 36 shows an embodiment of the invention which can retrieveadditional visual information such as documents corresponding todestination location coordinates within geographic visual information.

FIG. 37 shows an embodiment of the invention which shows how selectionof destination location coordinates within geographic visual informationallows navigation within a building or other type of structure.

V. MODE(S) FOR CARRYING OUT THE INVENTION

A plurality of images each spatially referenced to coordinate locationswithin a computed navigation space from a selectable origin coordinatelocation implement three dimensional navigation of the computednavigation space. A user can serially select destination coordinateswithin each of the plurality of images to experience three dimensionalnavigation within digitally recordable characteristics of a spaceincluding without limitations audio characteristics, spectralcharacteristics, energy characteristic, visual characteristics,geographic characteristics, anatomical structure, a city, a region, orthe world, or the like.

Now referring primarily to FIG. 1, a computer application provides acomputed navigational space (1) generated as an representation (2)within a first visual field (3) having a plurality of selectablelocation coordinates (4) which allow access (5) to at least one database(6) stored within a memory element (7) to generate visual information(8) spatially referenced to the computed navigation space (1) from theselected location coordinates (4) for display within a second visualfield (9).

As discussed above the computed navigation space (1) can comprise anymanner of space constructed by the computer application regardless ofthe number of dimensions, geometric properties, manner of symmetry,whether finite or infinite, having any location within such computednavigation space (1) identifiable by the indexing of two or morelocation coordinates (which may refer to column or row information) (4).

The following components can be used to implement the computednavigation space (1) described above. It is understood, that this listof components is not limiting with respect to the numerous and variedembodiments of the invention. Rather, it is intended that the componentslisted are illustrative of how to make and use the numerous and variedembodiments of the invention whether the embodiments involve withoutlimitation a computed tomography of anatomical structure, computedgeographic space, computed auditory space, computed spectral or energyspace, or the like.

The computer application used to generate the computed navigationalspace (1) can be implemented in any commercially available relationaldatabase system (RDBMS) such as Oracle, Microsoft SQL Server, MicrosoftAccess, IBM DB2. For Internet applications, a web server can further actto implement a standard web server software, such as Microsoft IIS,Apache, and iPlanet. The system does not need to be implemented using anRDBMS. The implementation could be through any data structure (objectdatabase, text file, etc) capable of storing the required data and datarelationships. Also, in some embodiments no pre-defined data structuremay be required, and all relationships are auto-calculated based oncoordinate relationships and photographic image parameters.

The computer application used to generate the representation (2)(whether a geo-planar map or otherwise) of the computed navigation space(1) identifies and implements without limitation standard map serverapplications such as ESRI ArcIMS, MapQuest, or Microsoft MapPoint.

Internet client applications of the invention can be implemented by acomputer application such as “pixearth.client” and “pixearth.servlets”set out by U.S. Provisional Application No. 60/377,642 (including thespecification, drawings and exhibits A through C), hereby incorporatedby reference in their entirety herein. The “pixearth” applications queueand broker requests sent from client applications acting as theinterface between the server (11) components and the clients requestswhich are passed through the web server to select images from thedatabase (6) based on a representation (2) that is transmitted from theclient such as HyperNav and also such as GeoFlick which essentiallygeo-references each frame that makes up a movie, so that the location(and direction of view) for each frame can be shown simultaneously on amap display.

While FIG. 1 shows only a single location coordinates (4) forillustrative purposes, a plurality of selectable location coordinateswithin the planar representation (2) of the computed navigation space(1) can define a coordinate location with the resolution of a singlepixel, if desired. As such, every pixel within the representation (2) ofthe computed navigation space (1) can be assigned location coordinates(4). Alternately, the number of pixels defining a coordinate locationcan vary depending on factors such as the scale of the representation(2) the dimensions of the first visual field (3) the relative space ofthe coordinate location to the computed space, or the like.

A positionably controllable navigation indicator (10) within the planarrepresentation (2) of the computed navigation space (1) within the firstvisual field (3) can be operably coupled to selected locationcoordinates (4) to access (5) a database (6).

The visual information (8) accessed (5) by selection of locationcoordinates (4) generated within the second visual field (9) can be anymanner of recordable characteristics of any space which can be digitallystored and spatially referenced to the computed navigation space. Assuch, the visual information (8), can be a fractional representation ofrecordable characteristics of the space sensorially perceivable to thehuman eye, a fractional representation of recordable characteristics ofthe earth, a fractional representation of recordable characteristics ofa city, a fractional representation of recordable characteristics ofthoroughfares (roads, highways, paths, or the like), a fractionalrepresentation of recordable geography, a fractional representation ofrecordable geography sensorially perceivable to the human eye, and afractional representation of anatomical structure.

In certain embodiments of the invention, the visual information (8)comprising recordable characteristics of the space can be one or morephotographic image(s) recorded from a coordinate location representedwithin the computed navigation space. The photographic image recordedfrom the coordinate location can include locations, features, or aspectswhich can define vectors of any direction or magnitude. The photographicimages can include without limitation geographic images of the Earth'ssurface, a city, a town, a building, or any portion thereof.

The second visual field (9) in which the visual information (8) isdisplayed can be separated from the first visual field (3) either bydisplay on a separate display screen (16) or by separation of the imageson the same display screen (16) or by overlaying the first visual field(3) with the second visual field (9).

A positionably controllable navigation indicator (12) within the secondvisual field (9) can be operably coupled to selectable locationcoordinates (13) within the visual information (8). While, FIG. 1 showsonly a single one of the selectable location coordinates (13) within thevisual information (8) for illustrative purposes, a plurality ofselectable location coordinates (13) within the visual information (8)can define a coordinate location with the computed navigation space (1)with resolution of a single pixel, if desired. As such, every pixelwithin the visual information (8) can be assigned selectable locationcoordinates (13).

Because the visual information (8) is spatially referenced to locationcoordinates within the computed navigation space (1), positioning of thepositionably controllable navigation indicator (12) within the visualinformation (8) can alter position of the positionably controllablenavigation indicator (10) within the computed navigation space (1) tothe same coordinates. In certain embodiments of the invention, aseparate location indicator (72) in the computed navigation space (1) iscoordinately coupled to the positionably controllable navigationindicator (12) in the visual information (8). In these embodiments ofthe invention, the positionably controllable navigation indicator (10)can remain at the selected coordinates (4) which comprise the origincoordinate location for the visual information (8) while the separatelocation indicator 72 shows coordinate location within the computednavigation space (1) of the location coordinates that correspond to thepositionably controllable navigation indicator (12) in the visualinformation (8). Importantly, this allows the user to understand thedirection and magnitude of the vector from the origin coordinatelocation to the location coordinates that correspond to the positionablycontrollable navigation indicator (12) within the visual information(8).

Upon selection of the location coordinates (13) within the visualinformation (8) operably coupled to the positionably controllablenavigation indicator (12), that portion of the database (6) related tothe location coordinates (13) selected can be accessed to generatedestination visual information (which can be one or a plurality ofimages) spatially referenced from the selected location coordinates(13). The destination visual information (14) may be displayed in athird visual field (15) separate from the first visual field (3) or thesecond visual field (9) within the same display screen (16) or ondifferent display screens. Alternately, the destination visualinformation (14) can replace or overlay the visual information (8)within the second visual field (9). In certain embodiments of theinvention the location indicator 20 or the positionably controllablenavigation indicator 10, or both, within the computed navigation space(1) can locate to the origin coordinate location from which thedestination visual information (14) is spatially referenced. Self-guidednavigation of the computed navigation space (1) can be implemented byserial selection of location coordinates (13)(25) first within thevisual information (8) and then in generated destination visualinformation (14).

Certain embodiments of the invention may provide a directional biaselement (19) either separately or responsive to one or both of thepositionably controllable navigation indicators (10)(12). Thedirectional bias element (19) can in the first instance be used to gateretrieval of visual information (8) from the database to selecteddirectional vector(s) from the location coordinates (4) in therepresentation (2) of the computed navigation space (1). In the secondinstance the directional bias element can be used to alter thedirectional bias of the gate to retrieve additional visual information(8) spatially referenced to the selected location coordinates (4). Inthe third instance, the directional bias element (19) can be used togate retrieval of destination visual information (14).

Location coordinates (4)(13)(25) within the computed navigation space(1) or in the visual information (8) or destination visual information(14) can further be used to access (17) at least one addition database(18) within the same computer or in a network (such as an office networkor the Internet) stored within a single or a plurality of memoryelements (7). Data representations or data presentations (21) retrievedfrom such additional databases (18) can be displayed in a fourth visualfield 22 within the display (16), or displayed on a separate displayscreen or by overlaying the any or all of the first visual field (3),the second visual field (9), or the third visual field (15) with thefourth visual field (22).

Again referring primarily to FIG. 1, spatial referencing of visualinformation (8) or destination visual information (14) to locationcoordinates within the computed navigation space (1) from selectablelocation coordinates (4) within the representation (2) of the computednavigation space (1) can be provided in some embodiments of theinvention by access (23) to a location coordinates match element (24).

Now referring primarily to FIGS. 2 to 6, examples of locationcoordinates match elements (24) that can be used to implement variousembodiments of the invention are shown. It is understood that thesespecific examples are not meant to be limiting with respect toimplementing the various embodiments of the invention described, butrather are illustrative of the numerous and wide variety of locationcoordinate match elements (24) that can or could be used to implementcertain basic functionalities of the invention. Embodiments of thelocation coordinates match element (24) provide a data structure (forexample, a table providing columns and rows) which relate locationcoordinates in the visual information (8) or location coordinates in thedestination visual information (14) to location coordinates in thecomputed navigation space (1).

Now referring primarily to FIG. 2, an embodiment of the locationcoordinates match element (24) matches coordinates in two-dimensionalvisual information (8) to three dimension space in the computednavigation space (1), and vice versa. The visual information Xcoordinates (25) and the visual information Y coordinates (26)corresponding to the visual information (8) are entered into a datastructure (30), which can be a table as shown in FIG. 2. A computednavigation space X coordinate (27), a computed navigations space Ycoordinate (28), and a computed navigation space Z coordinate (29) areassigned to each visual information coordinate location (visualinformation X, visual information Y) in the data structure (30).

A coordinate location (13) within the visual information (8) is selectedby the user and the computer application locates the matching or theclosest to matching visual information X coordinate (25) and the visualinformation Y coordinate (26) in the data structure (30). Thecorresponding computed navigation space X, Y, Z (27)(28)(29) can then beutilized to identify location of the selected visual informationcoordinate location within a separate representation (2) of the computednavigation space.

Now referring primarily to FIG. 3, an embodiment of the locationcoordinates match element (24) matches a visual information X coordinate25 and a visual information Y coordinate 26 to a computed navigationspace location (31) in a first data structure (32). In a second step,the computed navigation space location (31) can then be matched tocorresponding computed navigation coordinates (27)(28)(29) within asecond data structure (33).

The visual information X coordinates (25) and the visual information Ycoordinates (26) corresponding to the visual information (8) are enteredinto the first data structure (32). A corresponding computed navigationspace location (31) is assigned to each visual information coordinatelocation (visual information X, visual information Y) in the datastructure (32). The assigned computed navigation space locations (31)are further entered into the second data structure (33) along with thecorresponding computed navigation coordinates (27)(28)(29).

This embodiment of the location coordinates match element (24) could beutilized by determining a location within the visual information (8)(for example, by positioning a cursor at the location). The computerapplication determines the pixel coordinates of the coordinate locationwithin the visual information (8). These pixel coordinates are utilizedwith a computer application to locate the matching, or the closest tomatching, visual information X-coordinate (25) and visual informationY-coordinate (26). The matching (or in certain embodiments closestmatch) navigation space location (31) is then used to match the computednavigation coordinates (27)(28)(29).

Now referring primarily to FIG. 4, with respect to another embodiment ofthe location coordinates match element (24), a data structure (34)provides a table in which visual information X and Y coordinates(25)(26) are entered along with corresponding database accessdefinitions (35)(such as an Internet URL).

This embodiment of the location coordinates match element (24) could beutilized by selecting a location within the visual information (8) ordestination visual information (14)(for example, position the navigationindicator (12) to that location in the visual information (8) to which acomputer application utilizes pixel coordinates to locate the matching,or the closest to matching, visual information X-coordinate (25) andvisual information Y-coordinate (26). The corresponding visualinformation X and Y coordinates (25)(26) which are then matched to thedatabase access definition (34). Information related to the selectedvisual information coordinate location can then be presented.

Now referring primarily to FIG. 5, an embodiment of the locationcoordinates match element (24) provides a first data structure (36) anda second data structure (38). In the first data structure visualinformation X coordinates (25) and the visual information Y coordinates(26) and corresponding database identifiers (37) are entered. In asecond data structure (38), the database identifiers (37) andcorresponding database access definitions (35) are entered.

This embodiment of the location coordinates match element (24) could beutilized by selecting a location within the visual information (8) ordestination visual information (14)(for example, positioning a cursor ata location in the visual information) to which a computer application ina first step utilizes pixel coordinates to locate the matching, or theclosest to matching, visual information X-coordinate (25) and visualinformation Y-coordinate (26) in the first data structure (36). Thecorresponding visual information X and Y coordinates (25)(26) are thenmatched to the database identifier (37). In a second step, the computerapplication (or a separate application) matches the database identifier(37) to the database access definition (35) in the second data structure(38).

Now referring to FIG. 6, an embodiment of the location coordinates matchelement (24) matches coordinates (25)(26) in two-dimensional visualinformation (8) to three dimensions (27)(28)(29) in the computednavigation space (1)(and vice versa) and to a database access definition(35). The visual information X coordinates (25) and the visualinformation Y coordinates (26) corresponding to the visual information(8) are entered into a data structure (39), which can be (withoutlimiting the invention solely to a rows and columns data structure) atable as shown in FIG. 6. A computed navigations space X coordinate(27), a computed navigations space Y coordinate (28), and a computednavigation space Z coordinate (29) are assigned to each visualinformation coordinate location (visual information X, visualinformation Y) in the data structure (39). The database accessdefinition (35) corresponding to the coordinates entered into each rowis further entered into the data structure (39). With respect to thedata structure (39), as shown by FIGS. 3 and 5 the data structure couldbe distributed across two or more, but related, data structures.

This embodiment of the location coordinates match element (24) could beutilized by selecting a location within the visual information (8) ordestination visual information (14)(for example, positioning thepositionably controllable navigation indicator (12) to the coordinatelocation (13) within the visual information (8)) to which a computerapplication utilizes pixel coordinates to locate the matching, or theclosest to matching, visual information X-coordinate (25) and visualinformation Y-coordinate (26) in the data structure (39). The determinedvisual information X and Y coordinates (25)(26) are then matched tocomputed navigation space coordinates X, Y, Z (27)(28)(29) and thedatabase access definition (35).

The invention further comprises embodiments of the coordinate matchelement (24) having an algorithm which utilizes, separately or incombination, the image X, Y pixel coordinates, camera focal length,camera geographic coordinates (location of camera on earth's surfacewhen image was captured) and attitude information to create a vectorthat can be intersected with topographic data (vector or raster) toautomatically transform the image x, y pixel coordinates to visualinformation X, Y coordinates (25)(26) or to computed navigation spacecoordinates X, Y, Z (27)(28)(29). The derived geographic coordinates canthen be used to select a new location for which photographic images willbe displayed. The derived geographic coordinates can also be used toshow a new location on the map display. The results of such calculationscan be stored as part of the system for retrieval as needed, or can becomputed on-the-fly as the user interacts with visual information.

Now referring primarily to FIG. 7, an embodiment of the invention caninclude the steps of accessing the computer application (40), andrequesting display of the computed navigation space as a representationwithin a first visual field of a visual display unit (41). By displayingthe computed navigation space as a representation within the firstvisual field (42), the user can further interact by selecting locationcoordinates in the computed navigation space (43), thereby displayingvisual information spatially referenced to coordinate locations withinthe computed navigation space from the selected location coordinateswithin a second visual field (44). The user further interacts byselecting a destination location within the visual information (45),thereby displaying destination visual information spatially referencedto coordinate location within the computed navigation space within athird visual field (46).

Now referring primarily to FIG. 8, an embodiment of the invention caninclude the steps of accessing the computer application (48), andrequesting display of the computed navigation space as a representationwithin a first visual field of a visual display unit (49). By displayingthe computed navigation space as a representation within the firstvisual field (50), The user can further interact by selecting locationcoordinates in the representation of computed navigation space (51),thereby displaying visual information spatially referenced to coordinatelocations within the computed navigation space from the selectedlocation coordinates within a second visual field (52). The user furtherinteracts by selecting a location within the visual information (53) toprovide a visual indication of such location within the representationof the computed navigation space (for example, highlighting orpointing)(54).

Now referring primarily to FIG. 9, an embodiment of the invention caninclude the steps of accessing the computer application (55), andrequesting display of the computed navigation space as a representationwithin a first visual field of a visual display unit (56) By displayingthe computed navigation space as a representation within the firstvisual field (57), The user can further interact by selecting locationcoordinates in the representation of computed navigation space (58),thereby displaying visual information spatially referenced to coordinatelocations within the computed navigation space from the selectedlocation coordinates in a second visual field (59). The user furtherinteracts by selecting a location within the spatially referenced visualinformation to access a database to retrieve information regarding theselected location within the visual information (60).

A further example of using a particular embodiment of the inventioncomprises using the positionably controllable navigation indicator (10)within a geo-planar map (representation (2)) of the computed navigationspace (1) in a first visual field (3) in a display (16) is used toselect the desired location coordinates (4) (for example by a click).The visual information (8) matched to the location coordinates (4)displays a photographic image or collection of photographic images eachtaken in a different direction (azimuth) to provide all or a portion ofa 360 degree view from an origin geographic location corresponding tothe selected location coordinates (4) in the computed navigation space(1). Each of the photographic images (visual information (8)) asdiscussed above are spatially referenced from the selected locationcoordinates (4) within the computed navigation space (1) locations(resolved to the pixel level) within the photograph can be related toparticular geographic locations (location coordinates (4)) on thegeo-planar map (representation (2)).

The user then positions the positionably controllable navigationindicator (12) within a photographic image (visual information (8)) at alocation (the location within the photograph can be indicated (incertain embodiments highlighted)) on the geo-planar map (2). The userthen selects (clicks) on a location in the photograph to navigate tothat destination location within the computed navigation space (1). Thedestination visual information (14) matched to the destination locationcoordinates (13) displays a photographic image or collection ofphotographic images each taken in a different direction (azimuth) toprovide all or a portion of a 360 degree view from an origin geographiclocation corresponding to the selected destination location coordinates(13) in the computed navigation space (1). In this way, the user cannavigate to any location on Earth through serial navigation ofphotographs.

Now referring primarily to FIGS. 10 to 37 describes an implementation ofa specific embodiment of the invention providing a geographic computednavigational space (1) displayed as a two dimensional geo-planar maprepresentation (2) having a plurality of selectable location coordinates(4), each upon selection, providing a plurality of geographic images asvisual information (8) spatially referenced to the location coordinates(4) within the geographic computed navigational space (1) from theselected location coordinates (4).

Now referring to FIG. 10 a list of tables (for example lists“GeoFlicklink”) in the database (6) that can used to implement theabove-described invention in a relational database system (RDBMS). Thespecific example shown utilizes Microsoft Access.

Now referring to FIG. 11 which shows an example schema of a“GeoFlicklink” table generated by selection of the “GeoFlicklink” fromthe table shown by FIG. 10 which establishes a data structure in whichthe location of information hyperlinks on geographic movie imagesutilized by the “GeoFlick” feature of the invention.

Now referring to FIG. 12 which shows an example of the “GeoFlicklink”table populated with data which coordinates the location of informationhyperlinks on “GeoFlick” geographic movie images.

Now referring to FIG. 13 which shows an example schema of data structurein which identifies geographic origin location coordinates of eachcorresponding geographic image, the azimuth of each correspondinggeographic image, and the serial order of presentation of eachcorresponding geographic image within a particular embodiment of the“GeoFlick” invention.

Now referring to FIG. 14 which shows the data structure of FIG. 13populated with the geographic origin location coordinates of eachcorresponding geographic image, the azimuth of each correspondinggeographic image, and the serial order of presentation of eachcorresponding geographic image which implements a particular embodimentof the “GeoFlick” invention.

Now referring to FIG. 15 which shows an example schema of the “link”table generated by selection of “link” from the table shown by FIG. 10which establishes a data structure in which the coordinate locationswithin geographic images spatially referenced to selectable coordinatelocations (4) (or other coordinate locations) within the geographiccomputed navigation space (1) are matched to hyperlinks to retrieveadditional database(s) (18) in accordance with the inventionabove-described.

Now referring to FIG. 16 which shows an example of the “link” tablepopulated with data which matches coordinate locations within geographicimages spatially referenced to selectable coordinate locations (4) (orother coordinate locations) within the geographic computed navigationspace (1) to hyperlinks which retrieve additional database(s)(18).

Now referring to FIG. 17 which shows an example schema of a “hyper”table which matches pixel coordinates within geographic images tohyper-navigation links on the geographic images (8) to retrievedestination location identifier to match associated destination locationcoordinates and destination geographic image (14) in a second datastructure (“location table” shown by FIG. 19) and a third data structure(“photo table” shown by FIG. 21). The pixel coordinates data describesthe destination location identifier to which the user navigates uponselecting location coordinates (13) by clicking on a location in thegeographic image (8).

Now referring to FIG. 18, which provides an example of a populated“hyper” table.

Now referring to FIG. 19 which shows an example schema of the “location”table referred to in FIG. 17 in which geographic coordinates of eachdestination location identifier are established. This also allowscoordinate locations (14) within the geographic image (8) to bedisplayed on the map.

Now referring to FIG. 20 which shows an example of a populated“location” table.

Now referring to FIG. 21 which provides an example schema of a “photo”table which associates multiple geographic photographic images (8) witha single origin coordinate location referenced to selectable locationcoordinates (4) within the geographic computed navigation space (1).This allows a user photo location to retrieve geographic photographicimages (8) taken in multiple directions from the same location. In someembodiments of the invention, azimuths for each image within a 360degree view provide directionally bias (19) of a plurality images. Incertain embodiments of the invention a single image can make up theentire 360 degree view (or portion thereof). In that embodiment, theazimuth of any pixel location coordinates within the single image can beinterpolated provided that the azimuth of an initial pixel location isknown.

Now referring to FIG. 22 which provides an example of a populated“photo” table.

Now referring to FIG. 23 which shows a geo-planar representation (2) ofthe computed navigation space (1) within a first visual field (3). Usercontrol buttons (61-63) on the toolbar (64) allows the user manipulatethe extent (63) and scale (61)(62) of the geo-planar representation (2)and to operate selectable location coordinates (4) within the geo-planarrepresentation to display visual information (8) in a separate secondfield by selecting the geo-planar navigation tool (65). By selecting thevisual information scaling tool (67), retrieved geographic images can beincreased in scale. By selecting representation enlargement tool (61)allows the user to view the representation (2) with higher resolution orby selecting the representation reduction tool (62) allows the user toview the representation with lower resolution. By selecting thegeo-planar image indexing tool (63) the user can pan the geo-planarimage.

Now referring to FIG. 24 which shows the geo-planar representation (2)of the computed navigational space (1) having the positionablycontrollable navigation indicator (10) being placed within a specifiedsearch tolerance of location coordinates (66) (highlighted in certainembodiments). This can indicate to the user that subsequent selection(click) of the location coordinates (66) will retrieve visualinformation (8) spatially referenced to the location coordinates withinthe computed navigation space (1) from the selected location coordinates(66).

Now referring to FIG. 25 which shows the result of clicking on theselectable location coordinates (66) in the geo-planar representation(2): 1) visual information (8)(geographic photographic image) spatiallyreferenced to location coordinates of the computed navigation space (1)from the selected location coordinates (66) is displayed in the secondvisual field (9); 2) the visual information can remain linked tolocation coordinates (66) by a persistent leader line (69). This leaderline will remain linked no matter where the second visual field (9) ismoved; 3) the arrow (70) indicates the azimuth (directional view) of theimage.

Now referring to FIG. 26 which shows positioning of the positionablycontrollable navigation indicator (12) (the cursor) over the visualinformation destination location coordinates (13) in the visualinformation (8) (geographic image) causes the corresponding geo-planarrepresentation destination location coordinates (71) to be highlighted.This can indicate to the user that the destination location coordinates(13) are enabled. By clicking the positionably controllable navigationindicator (12) on the destination location coordinates (13), the usercan geographically navigate to the destination location coordinates(13). Pixel coordinates in the destination visual information (14) arespatially referenced to location coordinates in the computed navigationspace (1).

Now referring to FIG. 27 shows the result of the user clicking on thepositionably controllable navigation indicator (12) as described in theprevious figure: 1) an active map image icon is changed to the newlocation (72); 2) the new location (72) displays a third visual field(15) graphically linked to the new location as shown in the geo-planarrepresentation (2); 3) the third visual field (15) shows an image withan azimuth direction looking back to the originating location, asindicated by the hyper-navigation icon (20); 4) the arrow (70) at thenew location (72) indicates the new azimuth direction. This process canbe repeated multiple times to hyper-navigate to any location on earth asprovided by the image server database.

Now referring to FIGS. 28, 29, and 30 also show the process ofhyper-navigation, however they show how the image viewer can havemultiple hyper-navigation icons (20) visible for selection by the user.

Now referring to FIG. 29, as in the initial example, show positioningthe cursor (positionably controllable navigation indicator (12)) overone of the hyper-navigation icon (20) in the geographic image (8) causesthe corresponding geo-planar representation (2) (map view) image icon(72) to be highlighted. In this example, the image viewer shows a skirun on a mountain overlooking a small town. The user has multiplehyper-navigation icon choices that relate to images or features in thetown.

Now referring to FIG. 30 which shows the result of clicking thepositionably controllable navigation indicator (12) within thegeographic image (8) retrieves a destination geographic image (14) whichin this specific embodiment of the invention corresponds to a coordinatelocation in the small town spatially referenced within the computednavigation space (1) from the view direction back toward the selecteddestination location coordinates (13).

Now referring to FIG. 31 shows a client window which shows that theinvention allows for additional visual information to be opened at thesame time. Each of the visual fields (15) (22) can be movedindependently within the display.

Now referring to FIG. 32 which shows an embodiment of the inventionhaving a visual field (9)(15)(22) with the a directional bias element(19) which allows the user to display multiple views from differentazimuth directions around the same geographic origin coordinatelocation. As the view direction changes a direction arrow (70) on thegeoplanar-representation (2) (map image) can also change to reflect thenew view direction (azimuth). The opposing arrow directions on thedirectional bias element (19) allows the view direction to change in aclockwise or counter-clockwise rotation around the geographic originlocation coordinates. The directional bias element can be implemented asdescribed above in a plurality of displayed visual information (8)(geographic images) or in a single 360 degree view, as described above.

Now referring to FIG. 33 which shows an example a three step sequence ina clockwise rotation is shown. Each click of the right arrow (73) on thedirectional bias element (19) increments the view one image frameclockwise. The increment rotation in azimuth (view direction) can bevariable based on how the geographic images were originally recordedfrom the geographic origin location coordinates. As the geographicvisual information is directionally biased the view direction arrow (70)in the geo-planar representation (2) can also change.

Now referring primarily to FIG. 34 which shows a visual field whichfurther comprise a temporal bias element (74) allow a plurality oftemporally distinct geographic views from the same geographic originlocation coordinates to differentiate, for example, seasonal views suchas Spring, Summer, Autumn (Fall) and Winter.

Now referring primarily to FIG. 35 the three part sequence in thisfigure shows how the invention can be implemented for the “GeoFlick”embodiment of the invention. User controls for enlargement (61) andreduction (62) and panning (63) allow manipulation of the geo-planarrepresentation (2). This embodiment of the invention can further includethe auto run element (75) to activate an automated sequence of imagesthat move the viewer geographically along a route, in this case astreet. The rate of the sequential display can be controlled with therate biasing element (76). As the directional indication arrow (70)advances along the street the photos change for each location of thearrow. In other embodiments the user would be able to move the cursoralong the highlighted path to display the images.

Now referring primarily to FIG. 36 which shows visual information (notto exclude audio) retrievable through selectable location coordinates(13) within images spatially referenced to the computed navigation space(1) from the additional database (18).

Now referring primarily to FIGS. 37A and 37B which show an embodiment ofthe invention which provides a computed navigation space (1) of abuilding having selectable location coordinates (4) which retrievesinterior building images spatially referenced to the computed buildingnavigation space (1) from selected location coordinates.

As can be easily understood from the foregoing, the basic concepts ofthe present invention may be embodied in a variety of ways. It involvesboth analysis techniques as well as devices to accomplish theappropriate analysis. In this application, the analysis techniques aredisclosed as part of the results shown to be achieved by the variousdevices described and as steps that are inherent to utilization. Theyare simply the natural result of utilizing the devices as intended anddescribed. In addition, while some devices are disclosed, it should beunderstood that these not only accomplish certain methods but also canbe varied in a number of ways. Importantly, as to all of the foregoing,all of these facets should be understood to be encompassed by thisdisclosure.

The discussion included in this application is intended to serve as abasic description. The reader should be aware that the specificdiscussion may not explicitly describe all embodiments possible; manyalternatives are implicit. It also may not fully explain the genericnature of the invention and may not explicitly show how each feature orelement can actually be representative of a broader function or of agreat variety of alternative or equivalent elements. Again, these areimplicitly included in this disclosure. Where the invention is describedin device-oriented terminology, each element of the device implicitlyperforms a function. Apparatus claims may not only be included for thedevice described, but also method or process claims may be included toaddress the functions the invention and each element performs. Neitherthe description nor the terminology is intended to limit the scope ofthe claims herein included.

It should also be understood that a variety of changes may be madewithout departing from the essence of the invention. Such changes arealso implicitly included in the description. They still fall within thescope of this invention. A broad disclosure encompassing both theexplicit embodiment(s) shown, the great variety of implicit alternativeembodiments, and the broad methods or processes and the like areencompassed by this disclosure and may be relied for support of theclaims of this application. It should be understood that any suchlanguage changes and broad claiming is herein accomplished. This fullpatent application is designed to support a patent covering numerousaspects of the invention both independently and as an overall system.

Further, each of the various elements of the invention and claims mayalso be achieved in a variety of manners. This disclosure should beunderstood to encompass each such variation, be it a variation of anembodiment of any apparatus embodiment, a method or process embodiment,or even merely a variation of any element of these. Particularly, itshould be understood that as the disclosure relates to elements of theinvention, the words for each element may be expressed by equivalentapparatus terms or method terms—even if only the function or result isthe same. Such equivalent, broader, or even more generic terms should beconsidered to be encompassed in the description of each element oraction. Such terms can be substituted where desired to make explicit theimplicitly broad coverage to which this invention is entitled. As butone example, it should be understood that all actions may be expressedas a means for taking that action or as an element which causes thataction. Similarly, each physical element disclosed should be understoodto encompass a disclosure of the action which that physical elementfacilitates. Regarding this last aspect, as but one example, thedisclosure of a “navigator” should be understood to encompass disclosureof the act of “navigating”—whether explicitly discussed or not and,conversely, were there effectively disclosure of the act of“navigating”, such a disclosure should be understood to encompassdisclosure of a “navigator” and even a “means for navigating.” Suchchanges and alternative terms are to be understood to be explicitlyincluded in the description.

Any patents, publications, or other references mentioned in thisapplication for patent are hereby incorporated by reference. Inaddition, as to each term used it should be understood that unless itsutilization in this application is inconsistent with suchinterpretation, common dictionary definitions should be understood asincorporated for each term and all definitions, alternative terms, andsynonyms such as contained in the Random House Webster's UnabridgedDictionary, second edition are hereby incorporated by reference.

I. U.S. Patent Documents

FILING DOCUMENT NO DATE NAME CLASS SUBCLASS DATE 2002/0038180 A1 Mar.28, 2002 Bellesfield, et al. 701 202 Jul. 10, 2001 2002/0023271 A1 Feb.21, 2002 Augenbraun, et al. 725 109 Dec. 15, 2000 4,086,632 Apr. 25,1978 Liess 364 444 Sep. 27, 1976 4926336 May 15, 1990 Yamada 364 444Dec. 27, 1988 4937753 Jun. 26, 1990 Yamada 364 449 Dec. 27, 1988 4954958Sep. 4, 1990 Savage, et al. 364 444 Aug. 19, 1988 4962468 Oct. 9, 1990Verstraete 364 443 Aug. 25, 1988 4984168 Jan. 8, 1991 Neukrichner, etal. 364 449 Jan. 4, 1988 5031104 Jul. 9, 1991 Ikeda, et al. 364 449 Nov.29, 1989 5041983 Aug. 20, 1991 Nakahara, et al. 364 449 Mar. 30, 19905067081 Nov. 19, 1991 Person 364 444 Aug. 30, 1989 5115399 May 19, 1992Nimura, et al. 364 449 Nov. 26, 1990 5168452 Dec. 1, 1992 Yamada, et al.364 449 Feb. 28, 1991 5170353 Dec. 8, 1992 Verstraete 364 449 Jun. 25,1991 5172321 Dec. 15, 1992 Ghaem, et al. 364 444 Dec. 10, 1990 5191406Mar. 2, 1993 Brandestini, et al. 358 22 Nov. 28, 1998 5191532 Mar. 2,1993 Moroto 364 449 Oct. 9, 1991 5189430 Feb. 23, 1993 Yano, et al. 342457 Jan. 28, 1992 5231584 Jul. 27, 1993 Nimura, et al. 364 444 Sep. 16,1991 5270937 Dec. 14, 1993 Link, et al. 364 449 Apr. 26, 1991 5274387Dec. 28, 1993 Kakihara, et al. G01S 3 02 Jul. 30, 1992 5293163 Mar. 8,1994 Kakihara, et al. 340 995 Aug. 18, 1993 5406619 Apr. 11, 1995Akhteruzzaman, et al. 379 95 Mar. 31, 1994 5408217 Apr. 18, 1995Sanderford, Jr. 348 506 Mar. 21, 1994 5414462 May 9, 1995 Veatch 348 135Feb. 11, 1993 5422814 Jun. 6, 1995 Sprague, et al. 364 449 Oct. 25, 19935440301 Aug. 8, 1995 Evans 348 970.11 Dec. 27, 1993 5442342 Aug. 15,1995 Kung 340 825.34 May 27, 1993 5450344 Sep. 12, 1995 Woo, et al. 364449 Apr. 22, 1994 5451757 Sep. 19, 1995 Heath, Jr. 235 382 Apr. 22, 19905471392 Nov. 28, 1995 Yamashita 364 443 Jun. 16, 1994 549929 Mar. 12,1996 Friedmann 360 18 May 24, 1995 5506644 Apr. 9, 1996 Suzuki, et al.354 106 Sep. 8, 1994 5508736 Apr. 16, 1996 Cooper 348 144 Jun. 15, 19955521587 May 28, 1996 Sawabe, et al. 340 815.45 Oct. 28, 1993 5523765Jun. 4, 1996 Ichikawa 342 451 Jun. 9, 1994 5526291 Jun. 11, 1996 Lennen364 581.82 Sep. 8, 1994 5530759 Jun. 25, 1996 Braudaway, et al. 380 54Feb. 1, 1995 5535011 Jul. 9, 1996 Yamagami, et al. 358 335 Mar. 18, 19945541845 Jul. 30, 1996 Klein 364 449 Aug. 2, 1994 5,559,707 Sep. 24, 1996DeLorme, et al. 364 443 Jan. 31, 1995 5,768,38 Jun. 16, 1998 Rosauer, etal. 380 21 Sep. 27, 1995 5,878,421 Mar. 2, 1999 Ferrei, et al. 707 100Jul. 17, 1995 6,035,330 Mar. 7, 2000 Astiz, et al. 709 218 Mar. 29, 19966,148,090 Nov. 14, 2000 Narioka 382 113 Nov. 10, 1997 6,199,014 Mar. 6,2001 Walker, et al. 701 211 Dec. 23, 1997 6,240,360 May 29, 2001 Phelan701 208 Aug. 16, 1996 6,263,343 Jul. 17, 2001 Hirano 707 104 Jan. 3,1997 6,282,362 Aug. 28, 2001 Murphy, et al. 386 46 Oct. 10, 19976,298,303 Oct. 2, 2001 Khavakh, et al. 701 289 Nov. 16, 2000 6,356,283Mar. 12, 2002 Guedalia 345 760 Jul. 10, 1998 5422814 Jun. 6, 1995Sprague, et al. 364 449 Oct. 25, 1993

II. Foreign Patent Documents

TRANSLATION DOCUMENT NO DATE COUNTRY CLASS SUBCLASS Yes No EP 0581659 A123.07.93 Europe G01C 23 00 EP 0581659 B1 26.03.97 Europe G01C 23 00 EP0581659 B1 23.07.93 Europe G01C 23 00 EP 0775891 A2 28.05.97 Europe G01C21 20 EP 0775891 A3 11.06.97 Europe G01C 21 20 EP 0775891 B1 12.05.99Europe G01C 21 20 EP 0802516 A2 22.10.97 Europe G08G 1 0969 EP 0841537A2 13.05.96 Europe G01C 21 20 EP 0841537 A3 27.10.99 Europe G01C 21 20EP 0845124 A1 17.05.00 Europe G06F 17 30 EP 0845124 B1 17.05.00 EuropeG06F 17 30 EP 1004852 A2 31.05.00 Europe G01C 21 34 EP 1004852 A322.08.01 Europe G01C 21 34 EP 1024347 A1 02.06.00 Europe G01C 21 36 EP1118837 A2 25.07.01 Europe G01C 21 30 WO 0144914 A1 21.06.01 PCT GO6F3/0 WO 0194882 A2 13.12.01 PCT G01C WO 0167200 A2 13.09.01 PCT G06F WO97/07467 27.02.97 PCT G06F 17 30 WO 98/0976 08.01.98 PCT HO4N7 173

III. Other Documents (Including Author, Title, Date, Pertinent Pages,Etc.)

“MSN MapPoint - Home Page”, http://www.mappoint.com, printed May 3,2002, 1 page “Internet Pictures Corporation - World Leader in DynamicImaging”, wysisyg://85/http://www.ipix.com, printed May 3, 2002, 1 page“Red Hen Systems, Inc. - Home”,wysiwyg://87/http:://www.redhensystems.com/, printed May 3, 2002, 1 page“GlobeXplorer”, wysiwyg:3/http://www.globexplorer.com, printed May 5,2002, 1 page “S.N.V.”, http://www.snv.fr, printed May 3, 2002, 1 page“Realator.Org Home Page”, wysiwyg://10/http://www.realtor.org . . .gn.nsf/pages/HomePage?OpenDocument, printed May 3, 2002, 1 page “Orbitz:Airline Tickets, Hotels, Car Rentals, Travel Deals”,wysiwyg://15/http://www.orbitz.com, printed May 3, 2002, 1 page “ExpediaTravel -- discount airfare . . . , vacation packages, cruises, maps”,http://www.expedia.com/Default.asp, printed May 3, 2002, 1 page “24/7Travel Professionals - Trip.com - 1.800.TRIP.COM”,wysiwyg://29./http://www.trip.com./trs.trip/home/index_01.xsl, printedMay 3, 2002, 2 pages

Thus, the applicants should be understood to claim at least: i) each ofthe computed navigation systems as herein disclosed and described, ii)the related methods disclosed and described, iii) similar, equivalent,and even implicit variations of each of these devices and methods, iv)those alternative designs which accomplish each of the functions shownas are disclosed and described, v) those alternative designs and methodswhich accomplish each of the functions shown as are implicit toaccomplish that which is disclosed and described, vi) each feature,component, and step shown as separate and independent inventions, vii)the applications enhanced by the various systems or componentsdisclosed, viii) the resulting products produced by such systems orcomponents, ix) methods and apparatuses substantially as describedhereinbefore and with reference to any of the accompanying examples, x)the various combinations and permutations of each of the previouselements disclosed, xi) processes performed with the aid of or on acomputer as described throughout the above discussion, xii) aprogrammable apparatus as described throughout the above discussion,xiii) a computer readable memory encoded with data to direct a computercomprising means or elements which function as described throughout theabove discussion, xiv) a computer configured as herein disclosed anddescribed, xv) individual or combined subroutines and programs as hereindisclosed and described, xvi) the related methods disclosed anddescribed, xvii) similar, equivalent, and even implicit variations ofeach of these systems and methods, xviii) those alternative designswhich accomplish each of the functions shown as are disclosed anddescribed, xix) those alternative designs and methods which accomplisheach of the functions shown as are implicit to accomplish that which isdisclosed and described, xx) each feature, component, and step shown asseparate and independent inventions, xxi) the various combinations andpermutations of each of the above, and xxii) each potentially dependentclaim or concept as a dependency on each and every one of theindependent claims or concepts presented.

It should be understood that for practical reasons and so as to avoidadding potentially hundreds of claims, the applicant may eventuallypresent claims with initial dependencies only. Support should beunderstood to exist to the degree required under new matterlaws—including but not limited to European Patent Convention Article123(2) and U.S. Patent Law 35 U.S.C §132 or other such laws—to permitthe addition of any of the various dependencies or other elementspresented under one independent claim or concept as dependencies orelements under any other independent claim or concept.

Further, if or when used, the use of the transitional phrase“comprising” is used to maintain the “open-end” claims herein, accordingto traditional claim interpretation. Thus, unless the context requiresotherwise, it should be understood that the term “comprise” orvariations such as “comprises” or “comprising”, are intended to implythe inclusion of a stated element or step or group of elements or stepsbut not the exclusion of any other element or step or group of elementsor steps. Such terms should be interpreted in their most expansive formso as to afford the applicant the broadest coverage legally permissible.

The claims set forth in this specification are hereby incorporated byreference as part of this description of the invention, and theapplicant expressly reserves the right to use all of or a portion ofsuch incorporated content of such claims as additional description tosupport any of or all of the claims or any element or component thereof,and the applicant further expressly reserves the right to move anyportion of or all of the incorporated content of such claims or anyelement or component thereof from the description into the claims orvice-versa as necessary to define the matter for which protection issought by this application or by any subsequent continuation, division,or continuation-in-part application thereof, or to obtain any benefitof, reduction in fees pursuant to, or to comply with the patent laws,rules, or regulations of any country or treaty, and such contentincorporated by reference shall survive during the entire pendency ofthis application including any subsequent continuation, division, orcontinuation-in-part application thereof or any reissue or extensionthereon.

1. A method of operating a computer, comprising the steps of: a)displaying a geographic representation including within a plurality ofgeographic location coordinates; b) selecting a first one of saidplurality of geographic location coordinates within said geographicrepresentation to establish a first geographic coordinate location insaid geographic representation; c) displaying a first image separatefrom said geographic representation which provides visual destinationinformation viewed from said first geographic coordinate locationestablished within said geographic representation, said visualdestination information viewed from said first geographic coordinatelocation including a first plurality of destination locationcoordinates; d) selecting one of said first plurality of destinationlocation coordinates within said visual destination information viewedfrom said first geographic coordinate location to identify a firstdestination location; e. matching said first one of said plurality ofdestination location coordinates with a second one of said plurality ofgeographic location coordinates to establish a second geographiccoordinate location within said geographic representation, said secondgeographic coordinate location identifying within said geographicrepresentation location of said first destination location selectedwithin said visual destination information of said first image; f.displaying a second image separate from said geographic representationwhich provides visual destination information viewed from said secondgeographic coordinate location established within said geographicrepresentation, said visual destination information viewed from saidsecond geographic coordinate location including a second plurality ofdestination location coordinates each selectable to identify a seconddestination location, said destination location coordinates matchable toa third one of said geographic location coordinates to establish a thirdgeographic coordinate location within said geographic representationidentifying within said geographic representation location of saidsecond destination location selected within said visual destinationinformation of said second image, thereby allowing serial navigation ofa plurality of images in relation to said geographic representation. 2.A method of operating a computer as described in claim 1, furthercomprising the step of providing a first directionally controllablenavigation indicator within said geographic representation.
 3. A methodof operating a computer as described in claim 2, further comprising thestep of directionally biasing said first image in relation to said firstgeographic coordinate location within said geographic representation byaiming a direction indicator responsive to said first directionallycontrollable navigation prior to said step of displaying said firstimage.
 4. A method of operating a computer as described in claim 3,further comprising the step of providing a second directionallycontrollable navigation indicator within said first image.
 5. A methodof operating a computer as described in claim 4, further comprising thestep of identifying with visual indicia said second coordinate locationwithin said geographic representation prior to said step of selectingone of said first plurality of destination coordinates within saidvisual destination information viewed from said first geographiccoordinate location.
 6. A method of operating a computer as described inclaim 5, further comprising the step highlighting said second coordinatelocation identified within said geographic representation.
 7. A methodof operating a computer as described in claim 6, further comprising thestep of directionally biasing said second image in relation to saidsecond coordinate location by aiming a second direction indicator withinsaid first image prior to said step of displaying said second imageviewed from said second coordinate location.
 8. A method of operating acomputer as described in claim 2, wherein said step of generating ageographic representation including within a plurality of geographiclocation coordinates comprises the step of generating a planargeographic representation including within a first plurality ofgeographic location coordinates.
 9. A method of operating a computer asdescribed in claim 8, wherein said planar geographic representationcomprises a geo-planar map.
 10. A method of operating a computer asdescribed in claim 1, wherein said at first image viewed from said firstcoordinate location is selected from the group consisting of a twodimensional fractional representation of digitally recordablecharacteristics within a computed navigation space, a two dimensionalfractional representation of digitally recordable characteristics withinsaid computed navigation space sensorially perceivable to the human eye,a two dimensional fractional representation of digitally recordablecharacteristics of the earth within said computed navigation space, atwo dimensional fractional representation of digitally recordablecharacteristics of a city within said computed navigation space, a twodimensional fractional representation of digitally recordablecharacteristics of thoroughfares within said computed navigation space,a two dimensional fractional representation of digitally recordablegeography within said computed navigation space, and a two dimensionalfractional representation of digitally recordable geography within saidcomputed navigation space sensorially perceivable to the human eye. 11.A method of operating a computer as described in claim 1, wherein saidsecond image viewed from said second coordinate location within saidgeographic representation is selected from the group consisting of a twodimensional fractional representation of digitally recordablecharacteristics within a computed navigation space, a two dimensionalfractional representation of digitally recordable characteristics withinsaid computed navigation space sensorially perceivable to the human eye,a two dimensional fractional representation of digitally recordablecharacteristics of the earth within said computed navigation space, atwo dimensional fractional representation of digitally recordablecharacteristics of a city within said computed navigation space, a twodimensional fractional representation of digitally recordablecharacteristics of thoroughfares within said computed navigation space,a two dimensional fractional representation of digitally recordablegeography within said computed navigation space, and a two dimensionalfractional representation of digitally recordable geography within saidcomputed navigation space sensorially perceivable to the human eye.